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Real Party in Interest 



The real party in interest is Pixel Tools Corporation, a 
California Corporation having an office at 10721 Wunderlich Drive, 
Cupertino, California 95015. 

Related Appeals and Interferences 

Appellant is unaware of any presently pending appeal or inter- 
ference that is related to this appeal. 

status of the Claims 

Claims 1-7 are pending in this application, claims 1-7 have 
been finally rejected, and that rejection of claims is being 
appealed. 



Appellant presented an amendment of independent claim 1 which 
corrects a grammatical error after an Examiner's Action, Paper No. 
5, mailed June 8, 2001, finally rejected claims 1-7. An Advisory 
Action, Paper No. 9, mailed October 19, 2001, states that the 
amendment presented after final rejection will be entered upon 
filing of a Notice of Appeal and this Appeal Brief with required 
fees. 

Dependent claims 2, 3 and 5 were last amended in a response to 
a first Examiner's Action dated December 6, 2000, Paper No. 2, that 
Appellant mailed on April 4, 2001. The response that was mailed on 



status of Amendments 
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April 4, 2001, also presented for the first time new dependent 
claims 6 and 7. 



As recited in twice amended independent method claim 1, the 

present invention encompasses: 

[a] method for producing a compressed video bit stream 
that includes compressed video data for a plurality of 
frames from data that specifies a single still image 



whereby decoding of the compressed video bitstream 
produces frames of video which produce images that do not 
appear to pulse visually. 

The invention solves a problem that appears in images produced by 

a conventional MPEG decoder when decoding a conventionally MPEG 

encoded video bitstream that reproduce a still image, particularly 

a still image containing text. 

A conventionally encoded MPEG video bitstream includes a 
sequence of groups of pictures ("GOPs") one of which is identified 
in FIG. 2 by reference number 52. Each GOP begins with an intra 
("I") frame that usually precedes at least one predicted ("P") 
frame and several bidirectional ("B") frames . Detail in decoded 
MPEG still images tends to be lower at the beginning of each GOP 
when an I frame is decoded, increases during decoding of successive 
P frames and B frames in the GOP, only to decrease again upon 
decoding the next I frame. 

Thus, decoding the conventionally encoded MPEG compressed 
video bitstream of a still image frequently produces a video image 



Summar 




Invention 
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that appears to pulse visually, usually at a frequency identical to 
the frequency at which GOPs occur in the compressed video 
bitstreairi, e.g. twice per second. In many instances, visual 
pulsing of the still image produced by decompressing a MPEG com- 
pressed video bitstream is commercially unacceptable. 

As recited in independent claim 1, the method which solves the 
problem of visual pulsing of images produced from a video bitstream 
that is conventionally MPEG encoded from a still image that the 
present patent application claims: 

1. fetches data for the still image; 

2. encodes the data for the single still image into data for 
an I frame; 

3. stores the encoded I frame data; and 

4. assembles the compressed video bitstream by appropriately 
combining data for: 

a. at least a single copy of the stored I frame; 

b. at least one null frame; and 

c. various headers required for decodability of the 
compressed video bitstream. 

The Issues 

1. Whether claims 1-7 are unpatentably obvious under 35 U.S.C. 
§ 103(a) over: 

a. United States Patent no. 5,689,589 entitled "Data 
Compression for Palettized Video Images" which 
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issued on an application filed December 1, 1994, by 
Michael J* Gormish and Martin P. Boliek ("the 
Gormish, et al. patent") : 
b. in view of: 

i. United States Patent no. 5,404,446 entitled 
"Dual Buffer Video Display System for the 
Display of Asynchronous Irregular Frame Rate 
Video Data" which issued April 4, 1995, on an 
application filed by Ronald J. Bowater, Barry 
K. Aldred and Stephen P. Woodman ("the 
Bowater, et al. patent") and 

ii. United States Patent no. 5,838,678 entitled 
"Method and Device for Preprocessing Streams 
of Encoded Data to Facilitate Decoding Streams 
Back-to Back" which issued on an application 
filed July 24, 1996, by Joseph W. Davis and 
Shawn M. Hayes ("the Davis, et al. patent"). 

2. Whether claims 2 and 3 are unpatentably indefinite under 35 
U.S.C. § 112, second paragraph for failing to particularly 
point out and distinctly claim the subject matter which 
applicant regards as the invention. 
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Claim Group 



Claims 1-3 's and 6-7 's rejection under 35 U.S.C. § 103(a) 
stand or fall by themselves. 

Claim 4's rejection under 35 U.S.C. § 103(a) stands or falls 
by itself. 

Claim 5's rejection under 35 U.S.C. § 103(a) stands or falls 
by itself. 

Claims 2's and 3's rejection under 35 U.S.C. § 112, second 
paragraph, stands or falls by itself. 
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The Cited References 

The Gormlsh, et al« Patent 

Exhibit A to this Appeal Brief presents those FIGs. and texts 
in the Gormish, et al. patent that are pertinent to the invention 
encompassed by the pending claims. The FIGs. and texts in Exhibit 
A hereto establish that during the processing of "frame sequence 
data"^ the frame store 204C, illustrated in FIG. 2 of the Gormish, 
et al. patent, is: 

1. initially empty and is unable to provide any context for 
very early pixels^; 

2. at the end of processing each pixel, to prepare for 
processing the next pixel, the context modeler 202C: 

a. cycles UCLK to update frame store 204C (C13) ; and 

b. then cycles PCLK to get the next pixel (C14)^; 

3. during pixel processing, the context modeler 202C: 

a. loads the current pixel into pixel register 402^ 

b. CP register 408 of the context modeler 202C "ad- 
dresses" frame store 204C to obtain the context 
pixels for the current pixel^; 



The Gormish, et al. patent col. 4, lines 55-58. 

^ The Gormish, et al. patent col. 7, lines 17-18. 

^ The Gormish, et al. patent col. 11, lines 11-13. 

^ The Gormish, et al. patent col. 9, line 20-21. 

^ The Gormish, et al. patent col. 9, lines 21-23. 
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c. determines the sameness context model and the 
residual context model and loads SMASK and RMASK 
(step Cl)%' and 

d. reads T from frame store 204C and X from pixel 
register 402. and tests whether or not the current 
pixel is the same as the corresponding pixel from a 
previous frame, i.e. performs the sameness test 

4. as the frame store 204C fills, the data for the oldest 
pixels are overwritten as new pixels are stored there®; 

5. frame store 204C need only be large enough to hold the 
values needed to determine future contexts^; 

6. if frame store 204C has enough space to hold the current 
pixel without overwriting any pixels which form the 
context for the current pixel, then PCLK can be substi- 
tuted for UCLK^° and 

7. if no context referred to pixel values from frames 
earlier than the immediately prior frame, storage is only 
needed for one full frame^^. 



6 


The 


Gormish, 


et 


al. 


patent 


col. 


10, 


lines 28-29. 


7 


The 


Gormish, 


et 


al. 


patent 


col. 


10, 


lines 38-46. 
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The 


Gormish, 


et 


al. 


patent 


col. 


1, 


lines 21-23. 
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The 


Gormish, 


et 


al. 


patent 


col. 


1, 


lines 23-25. 


10 


The 


Gormish, 


et 


al. 


patent 


col. 


9/ 


lines 5-8. 


11 


The 


Gormish, 


et 


al. 


patent 


col. 


7, 


lines 25-27. 
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The texts from the Gorinish, et al. patent presented in Exhibit 
A and the preceding summary thereof irrefutably establish that: 

1. the disclosed method operates on a sequence of image 
frames; and 

2. at no time does the frame store 2Q4G depicted in FIG, 2^ 
store an encoded T frame of data as alleged in the 
Examiner's Action dated June 8, 2001, in lines 3-4 on 
page 3 thereof. 

Rather, the text of the Gormish, et al. patent at best discloses 
that the frame store 204C: 

1. stores only unencoded pixel values for those pixels which 
precede the present pixel; and 

2. supplies unencoded pixel values to the context modeler 
202C for use in performing the sameness test X=T. 

That is, the Gormish et al, patent does not disclose a transfer of 
pixel values stored in the frame store 2Q4G through the entropy 
coder 2Qag into the compressed file 22 0. 

Regarding the storage capacity of the frame store 204C, it 
need only be large enough to hold the values needed to determine 
future contexts. However, the amount of data preserved in the 
frame store 204C depends upon the particular context model 
performed by (implemented in) the context modeler 202C. Therefore, 
the frame store 204C may store unencoded pixel values for more than 
one frame if: 

The Gormish, et al. patent col. 7, lines 23-25. 
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!• required to do so by the context model performed by 
(implemented in) the context modeler 202C; or 

2. has enough space to hold the current pixel without 
overwriting any pixels which form the context for the 
current pixel. 

As set forth in Exhibit A, the block diagram FIG. 3 depicts a 
decompressor 122 whose operation is illustrated in the flow chart 
of FIG. 7. The Gormish, et al. patent discloses merely that a 
context modeller 202D of the decompressor 122 stores pixels into 
and retrieves pixels from the frame store 204D^^. 

Despite repeated diligent searches of the Gormish^ et al» 

patent J. Appellanii is able to find in that reference i 

1^ only a single mention of a "still image lQ4"j^y and 
2^ not a single additional occurrence of; 




Regarding the text in the Gormish, et al. patent identified in the 
Examiner's Action dated June 8, 2001/^ Appellant is able to find 
in that text only a single instance which mentions the "still image 
104." Appellant is unable to find in the cited text, or anywhere 




the word "still;" or 



1^ 



the reference Tiumber 104; 



anywhere else throughout that entire reference including 



the reference's claims . 



13 



The Gormish, et al. patent col. 12, lines 14-20. 



14 



The Gormish, et al. patent col. 4, line 50. 



15 



The Gormish, et al. patent col. 4, lines 49-65. 
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else in the Gormish, et al. patent, any further discussion 
regarding the still image 104, or regarding an I frame, i.e. a 
frame of compressed video data which can be decoded without 
reference to data in another frame of video data. 

Despite repeated diligent searches of the Gormish, et al. 
patent, Appellant is unable to find therein any disclosure or 
suggestion of: 

1. encoding data for a still image into data for an I 
frame as expressly required by independent claim 1; or 

2. a null frame; or 

3. combining data for the I frame with that for a null 



Correspondingly, despite repeated diligent searches of the Gormish, 
et al. patent. Appellant is unable to find therein any disclosure 
or suggestion that decoded still images that have been encoded in 
accordance with the reference's disclosure do not pulse visually. 

The Bowater, et al. Patent 

The Bowater, et al. patent addresses the technological problem 



[i]n computer-based video communication systems, a video 
signal is obtained from the camera at a constant frame 
rate but, after tranamisaion across the asynchronous or 

non-ideal network the frames arrive at irregular 

intervals, some frames arrive earlyj. some are delayedj. 

and bunching tsan occur. The display device at the 
receiving terminal, however, generally requires a 
constant frame rate supplied to it (e.g., to match the 
raster scan rate of a CRT) . In such systems it is 
therefore necessary to match the irregular arrival of 



frame. 



that: 
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frames over the network with the constant supply required 
to the output screen. 

•k "k k 

The designer of computer based video communication 
systems is . • • faced with the problem of how to 
achieve regular play-out of the asynchronous incoming 
video signal while, at the same time, minimising the 
number of buffered video frames. (Col. 1, lines 38-64) 
(Emphasis supplied.) 

Exhibit B to this Appeal Brief presents those FIGs. and texts 
in the Bowater, et al. patent that are pertinent to the invention 
encompassed by the pending claims. The FIGs. and texts in Exhibit 
B hereto establish that the Bowater, et al. patent, discloses: 

1. an apparatus and procedure for buffering motion video 
data in a decoding device prior to displaying an image on 
a screen that accommodates irregular arrival of frames of 
video data due to their transmission across an asynchron- 
ous or non-ideal network;^^ and 

2. accommodating insufficient data arriving at the decoding 
device via the asynchronous or non-ideal network by: 

a. temporarily freezing the image appearing on the 
screen by adding null frames and 

b. subsequently throwing away real data when data of 
the delayed frames of data does arrive.^® 



The Bowater, et al. patent col. 1, lines 40-49. 

The Bowater, et al. patent col. 3, line 65 - col. 6, line 
28. 



18 



The Bowater, et al. patent col. 4, lines 29-41. 
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Despite diligently searching the Bowater, et al, patent, Appellant 
is unable to find there any disclosure or even a suggestion that 
the disclosed buffering technique prevents still images from 
pulsing visually. 

The Davis, et al. Patent 

FIGs. 2, 3A, 3B, 5 and 6 of the Davis, et al. patent respec- 
tively illustrate: 

1. FIG. 2, the syntax of an MPEG II PES packet; 

2. FIGS. 3a and 3b, the organization of an MPEG II video 
sequence; 

3. FIG. 5, the structure of a picture header of the MPEG II 
video sequence of FIGS. 3a and 3b; and 

4. FIG. 6, the structure of a group of pictures header of 
the MPEG II video sequence of FIGS. 3a and 3b. 

The Davis, et al. patent provides the illustrations listed above as 
background art necessary for a proper understanding of the 
invention which that reference's discloses. 

Exhibit C to this Appeal Brief presents those FIGs. and texts 
in the Davis, et al. patent that are pertinent to the invention 
encompassed by the pending claims. The FIGs. and texts in Exhibit 
C hereto establish that the problem solved by the Davis, et al. 
patent is eliminating a one (1) second delay that occurs if both 
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the video decoder and the audio decoder must be reset before 
beginning to decode a subsequent program. 

To solve the preceding technological problem the Davis, et al. 
patent discloses a method which: 

1. first verifies that the multiplexed stream complies with 
an encoding standard 

2. preprocesses packets of the packetized and encoded: 

a. video sequence such that no video artifacts are 
produced when the video decoder decodes the immedi- 
ately following encoded video sequence and 

b, audio data sequence such that its: 

i. start time is within a first predetermined 
time of the start time of the video sequence 
and 

ii. temporal length is within a second predeter- 
mined time of the temporal length of the video 
sequence . 

The step of preprocessing the packets of the 
packetized, encoded, video sequence preferably includes 
deleting any video frames: 



19 



20 



21 



22 



23 



The Davis, et al. patent col. 5, lines 3-6. 

The Davis, et al. patent col. 6, lines 3-5. 

The Davis, et al. patent col. 6, lines 5-8. 

The Davis, et al. patent col. 6, lines 8-11. 

The Davis, et al. patent col. 6, lines 11-13 
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1. that cannot be decoded if video frames of the video 
sequence are not temporally correct and 

2. following a code indicating an end of the encoded video 
sequence. 

The step of preprocessing the packets of the packetized, encoded, 
audio sequence preferably includes: 

!• removing any partial audio frames 

2. adjusting the number of audio frames, if necessary: 

i. so the audio and video sequences start within 
the first predetermined time;^^ and 

ii. such that the temporal lengths of the audio 
and video sequences are within the second 
predetermined time.^® 

Despite diligently searching of the Davis, et al. patent. 
Appellant is unable to find: 

1. any mention there that the disclosed preprocessing method 
may be used advantageously in encoding still images in 
accordance with the MPEG I or MPEG II standards, or 

2. using null frames in any compressed video encoding. 



The Davis, et al. patent col. 6, lines 15-17, 

The Davis, et al. patent col. 6, lines 17-19. 

2^ The Davis, et al. patent col. 6, lines 19-21. 

The Davis, et al. patent col. 6, lines 21-24. 

The Davis, et al. patent col. 6, lines 24-27. 
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Furthermore, despite diligently searching the Davis, et al. 
patent Appellant is also unable to find any disclosure or sugges- 
tion that the disclosed preprocessing technique prevents still 
images from pulsing visually. 

Thus, at best, the Davis, et al. patent discloses: 

1. in FIGs. 2, 3A, 3B, 5 and 6 some information about how 
compressed video data may be encoded in accordance with 
the MPEG standard; and 

2. that video data compressed in accordance with the MPEG 
standard can be pre-processed to avoid a one (1) second 
gap at junctions between different MPEG encoded pro- 
grams . 

Legal Principles Applicable to 
Rejections Under 35 U.S.G, lQ3(a) 

Certain well established principles are to be applied in 
assessing whether or not an invention is patentable under 35 U.S.C. 
103(a) . First, the claims of a patent, which define the invention, 
are "to be construed in light of the specification and both are to 
be read with a view to ascertaining the invention." ilnitfid-Stataa 
V- Adamg , 383 U.S. 39, 49, 148 USPQ 479, 482 (1966). The "differ- 
ences between the prior art and the claims at issue are to be 

ascertained." araham v. John neerp Co. , 383 U.S. 1, 17, 148 USPQ 
459, 467 (1966). Moreover, it is elementary that the claimed 
invention must be considered as a whole in deciding obviousness. 

T.itton Industrial Product s, Tnn. v. Solid State Systems Corp.j 755 
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F,2d 158, 164, 225 USPQ 34, 38 (Fed. Cir, 1985). The prior art as 
a whole fflURt- be considered, and those portions of the prior art 
arguing against or teaching away from the claimed invention must be 

considered. Rausch & T.rnnh^ Tnn v. Rarnpg-Hi nd/HydrnniirvP^ Tnn., 
796 F.2d 443, 448, 230 USPQ 416, 420 (Fed. Cir. 1986), Tn re 
Hedgf^g^ a1 . ^ 783 F.2d 1038, 1041, 228 USPQ 685, 687 (Fed. Cir. 
1986) . 

An invention is obvious under 35 U,S,C- § 103 (a) j. only if the 
prior art suggests a modification of the refere nce (a) and/or their 
combination. In Tn re C^ordon^ 733 F.2d 900, 902, 221 USPQ 1125, 
1127 (Fed. Cir. 1984) the Court of Appeals for the Federal Circuit 
("CAFC") reversed a Board of Appeals decision that a patent 
application's claims were obvious under 35 U.S.C. § 103 holding 
"that although a prior art [fuel filter] device could have been 
turned upside down, that did not make the modification obvious 
unless the prior art fairly suggested the desirability of turning 
the device upside down." Continental Can Cn. TL^A^ Tnc. v. Monsanto 

Cq. 948 F.2d 1264, , 20 USPQ2d 1746, 1751 (Fed. Cir. 1991). 

"The mere fact that the prior art could be . . . modified would 
not have made the modification obvious unless the prior art 
suggested the desirability of the modification." Tn re (Gordon , 
supra at 221, 1127. In accord, Tn re T.askowski , 871 F.2d 115, 117, 
10 USPQ2d 1397, 1398 (Fed. Cir. 1989). " [E] laments of separate 
prior patents cannot b e combined when there is no suggestion of 
such combination anywhere in those patents" . Pandnit Corp. v. 
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np>nnifir>n Mamif antnr i ng rn, , 810 F.2d 1561, 1568, 1 USPQ2d 1593, 

1597 (Fed. Cir. 1987) citing AC.q Hoapi-hal SyR-hP.TTifi, Tnc, 

MontefiorP Hnapit^l, 732 F.2d 1572, 1577, 221 USPQ 929, 933 (Fed. 

Cir. 1984). (Emphasis supplied.) An examiner is obliged to. 

explain why cQ mhining references is proper indicaiiing why one 

skilled in the art would make a eombination or subs titui: ion. £x 
parte Skinner , 2 USPQ2d 1788, 1790 (Bd. Pat. App. & Int. 1986). 

"When relying on numerous references . , , ^ » , thfi 

examiner - - . [must] identify aiUOfi suggestion tO combine 

references or make the modification." In re Mayne, 104 F.3d 1339, 
1342, 41 USPQ2d 1451, 1454 (Fed. Cir. 1997) citing Tn re Jonps 958 
F.2d 347, 351, 21 USPQ2d 1941, 1943-44 (Fed. Cir. 1992). (Emphasis 
supplied.) "In reviewing the Board's obviousness conclusions, we 
have been guided by the well-settled principles that the claimed 
invention must be considered as a whole ^ multiple cited prior art 
references must suggest the desirability of being eombinedj. and the 
references must be viewed without the benefit of hindsight afforded 
by the disclosure." Tn rp P;^ii1c;pn^ 30 F.3d 1475, 1482, 31 USPQ2d 
1671, 1676 (Fed. Cir. 1994). " [T]he absence of such a suggestion 
tiQ comb ine is dispositive in an obvious determination . " nambrn 
T.undia AB v. Baxter Healthcare Corp., 110 F.3d 1573, 1578-79, 42 
USPQ2d 1378, 1383, 1384 (Fed. Cir. 1997) (Emphasis supplied) 

Finally, it is imperTni saibl e to first ascertain factually what 
the inventor did and then view the prior art in such a manner as to 
select from the random facts of that art only those which may be 
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modified and then utilized to reconstruct the invention from such 

prior art. Panduit Corp. v. Dennison Manufacturing Co. , 774 F.2d 

1082, 1092, 227 USPQ 337, 343 (Fed. Cir. 1985). 

A critical step in analyzing the patentability of 
claims pursuant to section 103(a) is casting the mind 
back to the time of invention, to consider the thinking 
of one of ordinary skill in the art, guided only by the 
prior art references and the then-accepted wisdom in the 
field. See Dfimhijczak, 175 F.3d at 999, 50 USPQ2d at 
1617. Close adherence to this methodology is especially 
important in cases where the very ease with which the 
invention can be understood may prompt one "to fall 
victim to the insidious effect of a hindsight syndrome 
wherein that which only the invention taught is used 
against its teacher." Id. (quoting W.T.. aore & Arsons. ^ 
Tnn. V. aarlQck, Inc ., 721 F.2d 1540, 1553, 220 USPQ 303, 
313 (Fed. Cir. 1983)). Tn ^/lf^lrr^f^lr Kntzah , 217 F.3d 
1365, 1369, 55 USPQ2d 1313, 1316 (Fed. Cir. 2000). 



Claims 1-7 Are Allowable 

Over the Cited References 

In rejecting claims 1-7 for obviousness under 35 U.S.C. 
§ 103(a) the Examiner's Action combines: 

1. a reference that discloses a pixel-based method for 
adaptively encoding a sequence of video frames ("the 
Gormish, et al. patent") ; with 

2. a reference that discloses an apparatus and method for 
buffering motion video data in a decoder ("the Bowater, 
et al. patent); and 

3. a reference that discloses a method for preprocessing 
packets of packetized, encoded, audio and video sequences 
that eliminates video artifacts and avoids having to 
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reset a decoder when sequentially decoding a sequence of 
two different programs ("the Davis, et al. patent"). 
In explaining application of the combined references to 
pending claims 1-7, the Examiner's Action dated June 8, 2001, 
confusingly states regarding the Gormish, et al. patent that: 

1. "Gormish et al. discloses a data compression for 
palettized video images as shown in Figures 1-3, and 
substantially the same method for producing a compressed 
video bitstream . . . ;"^^ 

2. "is being relied upon for the claimed f eature of 'decod- 
ing of the compressed video bitstream produces frames of 



visually* and 
3. "the decoder of Gormish et al. provides substantially the 
same if not the same decoding of the compressed video 
bitstream producing frames of video which produces image 
that do not appear to pulse visually as claimed. "^^ 

Deeompresaor 122 

If the second and third of the preceding quotations from the 
Examiner's Action correctly characterizes application of the 



Page 2 of the Examiner's Action dated June 8, 2001, last 
2 lines. 



Page 6 of the Examiner's Action dated June 8, 2001, 5th 
ana 6th lines from the bottom. 



Page 6 of the Examiner's Action dated June 8, 2001, last 
line and top 2 lines of page 7. 



video which produc 



that do not appear to pu l se 
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Gormish, et al. patent to pending claims 1-7, this argument 
refuting the rejection of those claims under 35 U.S.C. § 103(a) 
need proceed little further. 

The claimed invention is a method for "producing compressed 
video data for a plurality of frames" which, upon being decoded by 
any MPEG compatible decoder, "produces frames of video which 
produce images that do not pulse visually. "^^ Thus, if the Gormish, 
et al. patent "is being relied upon for the claimed feature of 
'decoding of the compressed video bitstream produces frames of 
video which produces image that do not appear to pulse visually'," 
and for "the decoder of Gormish et al. [providing] substantially 
the same if not the same decoding of the compressed video bitstream 
producing frames of video which produces image that do not appear 
to pulse visually as claimed," that referentse necessarily fails to 
disclose or to suggest the claimed invention, i.e. "producing a 
compressed video bitstream," and therefore claims 1-7 traverse 
rejection for obviousness under 35 U.S.C. § 103(a). 

If the failure of the decoder (decompressor 122) disclosed in 
the Gormish, et al. patent and/or in the Bowater, et al. patent to 
disclose or to suggest the "producing a compressed video bitstream" 



Appellant respectfully submits that it is significant to 
consideration of the pending claims that the various MPEG 
specifications, while expressly including in at lest some 
instances a model, i.e. definition, for a decoder, all 
omit any model, i.e. definition, for an encoder. That 
is, the various MPEG standards do not expressly disclose, 
nor do they even expressly suggest, any apparatus for or 
method for encoding, i.e. producing, a compressed video 
bitstream that conforms to the standard. 
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invention encompassed by claims 1-7 might somehow be perceived as 
being insufficient to traverse rejection of those claims under 35 
U.S.C. § 103(a), then the admitted failure of the Gormish, et al. 
and/or the Bowater, et al. patents to expressly disclose or to 
suggest "visual pulsing" of images irrefutably establishes the non- 
obviousness of claims 1-7 under controlling legal precedent. 

Because the Gormish, et al. and/or the Bowater, et al. patents 
fail to expressly disclose or to suggest "visual pulsing" of 
images, the rejection of claims 1-7 under 35 U.S.C. § 103(a) set 
forth in the Examiner's Action dated June 8, 2001, must necessarily 
rely upon inherent operation of the decoder (decompressor 122) 
depicted in FIG. 3 of the Gormish, et al. patent and/or the AMU 
card 125 depicted in FIG. 2 of the Bowater, et al. patent, that are 
described respectively in those references' texts associated with 
those FIGs. "The mere fact that a certain thing may result from a 
given set of circumstances in not sufficient" for inherency. Ex 
partP, fiV-innpr , 2 USPQ2d 1788, 1789 (Bd. Pat. App. & Int. 1986). If 
a claimed invention is not clearly anticipated by a reference, i.e. 
if the invention is not fully disclosed in a single prior art 
reference or embodied in a single practice or device, arguments of 
inherency are immaterial^^. Jonp.s pt al . v. Hardy j. 727 F.2d 
1529-30, 220 USPQ 1021, 1025-26 (Fed. Cir. 1984). Inherency . . 
may not be established by probabilities or possibilities. 



33 



For example in a rejection of claims under 35 U.S.C. 
§ 103(a) . 
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"'That which may be inherent is not necessarily known. Obviousness 
cannot be predicated on what is unknown. *" Tn rp Np.wpI 1 , 891 F.2d 
899, 901, 13 USPQ2d 1248, 1250 (Fed. Cir. 1989). Thus, as a matter 
of law, a combination of the decoders (decompressor 122) disclosed 
in the Gormish, et al. and/or the Bowater, et al. patents cannot 
render claims 1-7 obvious under 35 U.S.C. § 103(a) based upon their 
inherent operation, and the Appellant respectfully requests that 
the rejection of claims 1-7 be immediately withdrawn, and those 
claims pass immediately to issue. 

Gompreaaor loa 

If for some reason the second and third quotations from the 
June 8, 2001, Examiner's Action set forth above do not accurately 
state the rationale upon which the Gormish, et al. patent is being 
applied in rejecting claims 1-7 for obviousness under 35 U.S.C. 
§ 103(a), and that reference is, in fact, being utilized for the 
compressor illustrated there in FIGs. 1, 2 and 4, then and only 
then need the Appellant present further arguments establishing that 
claims 1-7 are allowable over the combined references of the 
Gormish, et al., Bowater, et al. and Davis, et al. patents. 

In characterizing in greater detail than that set forth above 
the disclosure of the Gormish, et al. patent, the June 8, 2001, 
Examiner's Action states, in the text beginning with the last two 
lines on page 2 of the Examiner's Action and continuing through the 
remainder of the paragraph top 2 lines of page 3: 
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1. "Gormish et al. discloses a data compression for 
palettized video images as shown in Figures 1-3, and 
substantially the same method for producing a compressed 
video bitstream that includes compressed video data for 
a plurality of frames from data that specifies a single 
still image as claimed in claims 1 and 4, comprising"; 

2. "substantially the same fetching the data for the still 
image (i.e., 104 of Figure 1);" 

3. "encoding data for the still image into data for an intra 
frame (i.e., [compressor] 108 of Figure 1 and see column 
4, lines 49-65) ;" 

4. "storing the encoded I frame data (i.e., [frame store] 
204C of Figure 2) ;" 

5. "assembling the compressed video bitstream by appropri- 
ately combining data for at least a single copy of the 
stored I frame (see Figure 2);" and 

6. "whereby decoding of the compressed video bitstream 
produces frames of video that do not appear to pulse 
visually (see [decompressor] 122 of Figure 1 and Figure 
3). 

Initially Appellant makes two observations regarding the 
preceding characterization of the Gormish, et al. patent. 

1. Item 6 of the characterization reinforce the position in 
the already discredited second and third quotations set 
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forth above from the June 8, 2001, Examiner's Action 
regarding the decoder (decompressor 122) . 
2. The entire one paragraph characterization quoted above 
includes only a single citation to a sixteen (16) line, 
contiguous segment of text in the Gormish, et al. patent, 
i,e, column 4, lines 49-65. 
The Appellant respectfully submits that the Examiner's Action 
avoidance of more extensive citation of texts in the Gormish, et 
al. patent in support of the rejection of claims 1-7 is puzzling if 
the Gormish, et al. patent truly uses, as alleged, "substantially 
the same method for producing a compressed video bitstream that 
includes compressed video data for a plurality of frames from data 
that specifies a single still image." why would the Examiner's 
action Qmit eitationa to the text regarding the illuatrationa of 
FTGa- 1-3 of the Gormiahj et al- patent if thoae texta would 



The extensive texts quoted above from the Gormish, et al. 
patent regarding the illustrations of FIGs. 1-4, 6 and 7 and the 
texts of the reference set forth in Exhibit A absolutely refute the 
preceding characterizations quoted above from the Examiner's Ac- 
tion. Rather, texts from the Gormish, et al. patent: 

1. at best disclose fetching a sequence of image frames of 




rt the rejecstion of the 



a still image 104: 



a. 



in FIG. 1; and 
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b. in the text in col. 4 at lines 51-58 describing 
FIG. 1; 

2. disclose the compressor 108 of FIG. 1 moves data for the 
sequence of image frames of the still image present in 
the original file 200 through a context modeller 202C, 
and an entropy coder 208C to form compressed file 220^^ 
representing a compressed version of original file 200^^; 

3. discloses storing into the frame store 204C in FIG. 2 
unencoded pixel values used subsequently for context 
comparisons, and not encoded T frame data as alleged in 
the Examiner's Action^%' and 

4. because an T frame is not stored in the frame sto re 20 AC , 
cannot disclose assembling the compressed video bitstream 
by appropriately combining data for at least a single 
copy of the I frame which the Examiner's Action dated 
June 8, 2001, falsely alleges is stored into the frame 
store 204C. 

For the preceding reasons, if the Examiner's Action were to attempt 
combining the compressor illustrated in FIGs. 1, 2 and 4 of the 
Gormish, et al. patent with the disclosures of the two other 



The Gormish, et al. patent col. 5, line 66 - col 6, line 
1. 

The Gormish, et al. patent col. 5, lines 60-61. 
The Gormish, et al. patent col. 6, lines 17-19. 
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references for rejecting claims 1-7 for obviousness under 35 U.S.C. 
§ 103(a), that attempt is doomed to fail. 

For these reasons, the Appellant respectfully submits that the 
paragraph quoted above from pages 2 and 3 of the Examiner's Action 
truly constitutes nothing more than an artful hindsight reconstruc- 
tion of the invention which, unfettered by expressly contradictory 
texts that appear in the Gormish, et al. patent, reads most of the 
text of pending claim 1 onto the illustrations of FIGs. 1-3 in that 
reference. The Appellant furthermore respectfully submits that 
this artful hindsight reconstruction is only possible if one 
completely ignores texts in the Gormish, et al. patent describing 
the illustrations of FIGs. 1-3. Moreover, even use of the artful 
hindsight reconstruction fails to render claims 1-7 obvious under 
35 U.S.C. § 103(a) because none of the three references cited in 
the Examiner's Action discloses or suggests: 

1. the reconstruction; or 

2 . that the reconstruction combined with the other two 
references would lead one of ordinary skill in the art 
to the solution of the problem encompassed by pending 
claims 1-7. 

Rebuttal of Examiner's 
Action Arguments 

The Examiner's Action dated June 8, 2001, criticizes arguments 
which the Appellant presented in a April 10, 2001, response to a 
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prior Examiner's Action. Relying upon case authority, the June 8, 
2001, Examiner's Action at the bottom of page 5 argues that: 

1. "[o]ne of ordinary skill in the art is presumed to 
possess a certain amount of background knowledge indepen- 
dent of the references;" and 

2. "[t]he conclusion of obviousness may be made from common 
knowledge and common sense of a person of ordinary skill 
in the art without any specific hint or suggestion in a 
particular reference." 

The first full paragraph on page 6 the June 8, 2001, Examiner's 
Action, again with a citation to case authority, criticizes the 
Appellant's response to rejection of claims based upon obviousness 
for attempting to "show nonobviousness by attacking references 
individually where, as here the rejections are based on combination 
of references." The cases citedin the Examiner's Action dated June 
8, 2001, hold that one of ordinary skill in the art is presumed to 
possess skill rather than stupidity, Tn t?^ f^ov-jsh j. 769 F.2d, 738, 
743, 226 USPQ 771, 774. (Fed.Cir. 1985);. A subsequent decision 
that cites Tn fiovish states: 

[t]aking into account the appropriate level of ski 1 1 in 
the art, we presume that a person having ordinary skill 
would exercise eQinmmi sense and sound judgment. Ex parte 
BfiCk, 9 USPQ2d 1995, 2002. (Bd. Pat. App. & Int'f 1987) 

(Emphasis supplied.) 

While the case authority of IiLXfi-Bozak, 416 F.2d 1385, 1390, 

163 USPQ 545, 549 (C.C.P.A. 1969), supports the proposition that: 

[t]he conclusion of obviousness may be made from common 
knowledge and common sense of a person of ordinary skill 
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in the art without any specific hint or suggestion in a 
particular reference, 

subsequent Federal Circuit decisions have limited the application 

of common knowledge and common sense in rejecting claims for 

obviousness under 35 U.S.C. § 103(a). For example, fiTrri the; 

Tndufit-.rififi M^diral fiystpms v. Vital fiigns, 183 F.3d 1347, 1356, 51 

USPQ2d 1415, 1421 (Fed.Cir. 1999), which cites Tn rp Ro^pV^ holds: 

[t]hat knowledge may have been within the province of the 
ordinary artisan does not in and of itself make it so, 
absent clear and convincing evidence of such knowledge* 
(Emphasis in the original.) 

Consequently, fimith Tndufitrifis holds that in rejecting claims 
for obviousness under 35 U.S.C. § 103(a) one cannot speculate about 
the common knowledge and common sense of the ordinary artisan. 
Smith Industries further holds that, as in the present application, 
if references lack any specific hint or suggestion that they be 
combined, the references may be combined to obtain the claimed 
invention, only after establishing the common knowledge and common 
sense of the ordinary artisan. Thus, a naked assertion about the 
common knowledge and common sense of the ordinary artisan, as set 
forth in the Examiner's Action dated June 8, 2001, is insufficient, 
by itself, under fiTni th Tndustr i es ^ supra, to permit combining 
references. 

Lastly, the June 8, 2001, Examiner's Action relying upon legal 
authority correctly observes that it is improper to "show 
nonobviousness by attacking references individually where, as here, 
the rejection is based on combination of references." Tn rp 
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Keller, 642 F,2d 413, 426, 208 USPQ 871, 882 (CCPA 1981) Analo- 
gously, as pointed out above, in deciding obviousness one must also 
consider the claim as a whole, T.i ttnn Tndugtr i a 1 ^ supra, and the 
prior art as a whole mucit. be considered, and those portions of the 
prior art arguing against or teaching away from the claimed 
invention must be considered, Ransnh & l,omhj Tnc.^ supra. However, 
in considering both the claims as a whole and the prior art as a 
whole, the Federal Circuit requires both: 

1. analyzing the prior art to identify there the source of 
various claim limitations in that art, and 

2. a motivation, teaching or suggestion to combine those 
claim limitations, smith TndiiRtrific;^ supra. 

Exhibit D to this Appeal Brief is a table containing the text 
of twice amended independent claim 1 juxtaposed with citations to 
locations as which various claim limitations appear in the Gormish, 
et al., the Bowater, et al. and the Davis, et al. patents. As 
such, Exhibit D compares the text of claim 1 as a whole with the 
disclosures of the three references taken as a whole. 

It is readily apparent from Exhibit D that none of the 
references, either alone or in combination, discloses: 

1. producing a compressed video bitstream that includes 
compressed video data for a plurality of frames from data 
that specifies a single still image, i.e. the invention; 

2. fetching the data for the single still image; 
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3. encoding the data for the still image into data for an I 
frame; or 

4. storing the encoded I frame data. 

Citing Tn kpI ipr j. the Federal Circuit recently held Tn re 
Kotzah, supra, that: 

[t]he test for an implicit showing is what the combined 
teachings, knowledge of one of ordinary skill in the art, 
and the nature of the problem to be solved as a whole 
would have suggested to those of ordinary skill in the 

art. SfiLfi Tn rp. Keller , 642 F.2d 413, 425, 208 USPQ 871, 
881 (CCPA 1981) (and cases cited therein) . Whether the 
Board reli es on an expreaa or an implieit showingj. it 
must provide pa rticular findings related thereto. See 

Dfimbiczak, 175 F.3d at 999, 50 USPQ2d at 1617. Broad 

conclusory stateme nts standing alone are not "evidence," 
Kotzab, at 1369, 1316. (Emphasis supplied.) 

Where, as in the present rejection of claims 1-7 for obviousness 

under 35 U.S.C. § 103(a) based upon a combination of the Gormish, 

et al, the Bowater, et al. and the Davis, et al. patents, the text 

of the Gormish, et al. patent expressly contradicts the rational 

for rejecting those claims presented in the June 8, 2001, 

Examiner's Action^^, the rejection of pending claims 1-7 necessarily 

lacks even credible broad conclusory statements that the Federal 

Circuit expressly prohibited Tn re TCntzab j id. 



For example, the allegation on page 3 of the Examiner's 
Action dated June 8, 2001, that the frame store 2 04C in 
the Gormish, et al. patent stores "the encoded I frame 
data (i.e., [frame store] 204C of Figure 2)" when the 
text of the reference, in fact, expressly discloses both 
in col. 6 at lines 16-19 and in col. 7 at lines 17-19 
that the frame store 204C receives only unencoded pixel 
values. The Gormish, et al. patent in col. 12 at lines 
14-20 similarly expressly discloses that the frame store 
204D of the decompressor 122 receives only unencoded 
pixel values. 
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What Combining The Three 

Referenceg Truly DiaGloaea 

Forgetting entirely the disclosure of the present application, 
what does a combination of the Gormish, et al., Bowater, et al. and 
Davis, et al. patents, taken as a whole, suggest to one of ordinary 
skill in the art about producing, that is not decoding, a com- 
pressed video bitstream that includes compressed video data for a 
plurality of frames? 

Clearly, the Gormish, et al. patent discloses that a compres- 
sor 108 (encoder) can encode a sequence of still image frames into 
a sequence of compressed video frames. If compression of the 
sequence of still image frames were performed in accordance with 
the MPEG standard disclosed in the Davis, et al. patent, and if the 
encoded sequence of compressed video frames were decoded using an 
MPEG decompressor 122 (decoder) similar to that disclosed in the 
Gormish, et al. patent, then images produced from the decoded 
compressed video frames will surely appear to pulse visually, 
usually at a frequency identical to the frequency at which GOPs 
occur in the MPEG compressed video bitstream, e.g. twice per 
second. 

If a network were interposed between the compressor 108 
(encoder) disclosed in the Gormish, et al. patent and the decom- 
pressor 122 (decoder) , then images produced from the decoded 
compressed video frames will undoubtedly continue appearing to 
pulse visually. If the network interposed between the compressor 
108 and the decompressor 122 were an asynchronous or non-ideal 
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network; and if the asynchronous network were at times unable to 
supply the decompressor 122 with sufficient compressed video data, 
then in according with the disclosure of the Bowater, et al. 
patent: 

after transmission across the asynchronous or non-ideal 
network, . . . frames [of compressed video data] arrive 
at [the decompressor 108 at] irregular intervals. Some 
frames arrive early, some are delayed, and bunching can 
occur . 

* * * 

In such [a system] it [would be] necessary to match the 
irregular arrival of frames over the network with the 
constant supply required to the output screen. (Col. 1, 
lines 40-49) 

Having access to the Bowater et al. patent, one of ordinary 
skill in the art would understand that, in accordance with the 
invention disclosed in that reference, the requirement that an MPEG 
implementation of the Gormish, et al. decompressor 108 receive 
frames of compressed video data at a constant rate despite delays 
introduced by the asynchronous or non-ideal network could be 
satisfied if: 

1. MPEG null frames were added to the compressed video 
data during intervals in which the network supplied an 
insufficient amount of video data; and 

2. thereafter, the decompressor 122 (decoder) deletes 
frames of compressed video data which arrived late. 

Thus, taken as a whole the Gormish, et al., Bowater, et al. 
and Davis, et al. patents do not disclose nor do they suggest to 
one of ordinary skill in the art any solution to the problem of 
still frame video images that appears to pulse visually. Further- 
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more, as Appellant has observed above, at a more fundamental level 
the combined references fail to disclose or to suggest express 
limitations that appear in the text of independent claim 1. 
Therefore, the Examiner's Action dated June 8, 2001, improperly 
rejects claim 1 under 35 U.S.C. § 103(a) for obviousness, and the 
rejection of independent claim 1, together with the rejection for 
obviousness of claims 2-7 which depend from claim 1, must be over- 
ruled. 



Claim 4 Is Allowable 
Over the Cited References 

Claim 4 depends from independent claim 1 and further restricts 

the claimed invention to a method for producing a compressed video 

bitstream in which: 



parameters employed in encoding the data for the still 
image produce an amount of data for the I frame that 
approaches, but remains less than, storage capacity of a 
buffer memory included in a decoder that stores the 
compressed video bitstream. 

The Examiner's Action dated June 8, 2001, couples the 

rejection of dependent claim 4 with the rejection of independent 

claim 1 alleging: 

wherein parameters employed in encoding the data for the 
still image produce an amount of data for the I frame 
that approaches, but remains less than, storage capacity 
of a buffer memory included in a decoder that stores the 
compressed video bitstream (see 204D of Figure 3).^® 



Page 3 of the Examiner's Action dated June 8, 2001, last 
3 lines at the end of the first paragraph. 
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As set forth above in the summarization of the Gormish, et al. 
patent's disclosure, that reference discloses only that the frame 
store 204D merely stores pixels received from the context modeller 
202D of the decompressor 122, and supplies pixels to the context 
modeller 2 02D^^ 

Despite a diligent search through all three references cited 
in the Examiner's Action dated June 8, 2001, which rejects 
dependent claim 4 under 35 U.S.C. § 103(a) for obviousness. 
Appellant is unable to find any disclosure in any of those 
references of encoding a frame of a video signal so the data for an 
I frame "approaches, but remains less than, storage capacity of a 
buffer memory included in a decoder that stores the compressed 
video bit stream." 

Since none of the references cited in the Examiner's Action 
dated June 8, 2001, disclose encoding a video signal so the data 
for an I frame "approaches, but remains less than, storage capacity 
of a buffer memory included in a decoder that stores the compressed 
video bitstream," the Examiner's Action dated June 8, 2001, 
improperly rejects claim 4 under 35 U.S.C. § 103(a) for obvious- 
ness, and that rejection must be overruled. 



The Gormish, et al. patent col. 12, lines 14-20. 
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Claim 5 Is Allowable 
Over the Cited References 

Claim 5 depends from independent claim 1 and further restricts 

the claimed invention to a method for producing a compressed video 

bitstream in which: 

null frames assembled into the compressed video bitstream 
also include bitstream stuffing whereby the compressed 
video bitstream is transmittable at a pre-established 
bitrate . 

The Examiner's Action dated June 8, 2001, acknowledges that 

the Gormish, et al. patent fails to disclose bitstream stuffing, 

To overcome this omission the Examiner's Action states: 

Davis et al discloses a method and device for preprocess- 
ing streams of encoded data to facilitate decoding 
streams back to back as shown in Figures 2, 3 A, 3B, 5, 
and 6, and teaches the conventional MPEG-1 and MPEG-2 
standard decodings (see column 1) , assembling the 
compressed video bitstream by appropriately combining 
data for headers such as sequence header, group start 
code, picture start code, sequence end code, picture 
header, and picture coding extension (see column 3, line 
41 to column 4, line 16) , as well as bitstream stuff ingg 
whereby the compressed video bitstream may be transmitted 
at a preestablished bitrate (see Figure 2),/^ 

FIG. 2 of the Davis, et al. patent "illustrates the syntax of a 

[packetized elementary stream] ("]PES[")] packet 200.''^" 

A "packetized elementary stream" (or PES) packet is a[n 
MPEG II] data structure used to carry "elementary stream 
data". An "elementary stream" is a generic term for one 
of (a) coded video, (b) coded audio, or (c) other coded 



Page 3 of the Examiner's Action dated June 8, 2001, 4th 
through 9th lines from the bottom of the page. 

Page 4 of the Examiner's Action dated June 8, 2001, 3rd 
through 8th lines in the final paragraph. 

The Davis, et al. patent col. 3, lines 14-15. 
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bit streams carried in a sequence of PES packets with one 
and only stream ID J' 

While FIG. 2 of the Davis, et al. patent depicts "stuffing bytes 

(OxFF)," Appellant is unable to find in that reference any text 

which further describes the illustrated "stuffing bytes (OxFF)." 

FIG, 1 of the Davis, et al. patent illustrates the syntax of 
an MPEG II transport stream, and of an MPEG II transport stream 
packet. Similar to FIG. 2 of the Davis, et al. patent, FIG. 1 also 
depicts stuffing bytes 136, and in col. 2 at line 44 mentions them. 
However, despite a diligent search of the text of the Davis, et al 
patent, Appellant is unable to find any further disclosure 
regarding the stuffing bytes 136 depicted in FIG. 2. 

Regarding bitrate, the Davis, et al. patent, in col. 11, line 

61 through col. 12, line 5, explains that: 

[t]he bit rate field [in the MPEG II sets a constant bit 
rate at which the transport stream (including audio PES 
streams, video PES streams, and program specific informa- 
tion (or "PSI") data) should be fed to a playback card 

810. The value of the bit rate field can be based on (i) 
the frame rate at which the video is to be displayed^ 
(ii) the file size, and (iii) the frame count . The frame 
rate is derived from a standard, such as the NTSC (or 
National Television Standards Committee) for example. The 
file size is determined by means of a system call by the 
preprocessor 922. The frame count is determined based on 
the number of picture headers 312 in the video sequence. 
(Emphasis supplied.) 

Appellant is unable to find in the Davis, et al. patent, or in 

either of the other two (2) cited references, any disclosure, or 

suggestion, that bitstreara stuffing, e.g. stuffing bytes (OxFF) or 



The Davis, et al. patent col. 1, lines 49-54. 
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stuffing bytes 136 in the Davis, et al. patent, be added to the 
compressed video bitstream so the compressed video bitstream is 
transmittable at a pre-established bitrate. Therefore, Appellant 
is unable to find, as expressly required by the text of dependent 
claim 5, in any of the cited references a disclosure that bitstream 
stuffing be included in null frames so the compressed video 
bitstream is transmittable at a pre-established bitrate. 

Since none of the references cited in the Examiner's Action 
dated June 8, 2001, disclose including bitstream stuffing in null 
frames so the compressed video bitstream is transmittable at a 
pre-established bitrate, the Examiner's Action dated June 8, 2001, 
improperly rejects claim 5 under 35 U^S.C. § 103(a) for obvious- 
ness, and that rejection must be overruled. 

Claims 2 and 3 Are 
AllQvably Definite 

The Examiner's Action dated June 8, 2001, maintains a 

rejection of claims 2 and 3 set forth in an Examiner's Action dated 

December 6, 2000, Paper No. 2, for being indefinite under 35 U.S.C. 

§ 112, second paragraph. Claim 2 requires that: 

the assembled compressed video bitstream is decodable in 
accordance with the MPEG-1 standard . . • 

Claim 3 requires that: 

the assembled compressed video bitstream is decodable in 
accordance with the MPEG-2 standard . . . 

In maintaining the rejection of claims 2 and 3, the Examiner's 
Action dated June 8, 2001, states: 
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the time frame between when the invention was reduced to 
practice till the time the application is filed, for 
example, there could be various versions of the recommen- 
dations. And unless the versions and dates of the 
recommendations are provided, the metes and bounds of the 
claimed limitations are not clearly set forth, and thus 
renders the claims indefinite. 

The Examiner's Action dated December 6, 2000, in initially 

rejecting claims 2 and 3 for being indefinite under 35 U.S.C. 

§ 112, second paragraph, states: 

claim 2, line 3, wherein the claim claims the "MPEG-1" 
recommendation is indefinite because there are many 
versions of the MPEG-1 recommendations and the recommends 
are continuously updated. The scope of the claim limita- 
tions cannot change over time, and unless the specifica- 
tion states a specific MPEG-1 version and date or a copy 
of the MPEG-1 recommendation is provided, the claim is 

indefinite; 

* * * 

claim 3, line 3, wherein the claim claims the "MPEG-2" 
recommendation is indefinite because there are many 
versions of the MPEG-2 recommendations and the recommends 
are continuously updated. The scope of the claim limita- 
tions cannot change over time, and unless the specifica- 
tion states a specific MPEG-2 version and date or a copy 
of the MPEG-2 recommendation is provided, the claim is 
indefinite ... 

First, it appears that the issue of the "Risk of the Future" 
which underlies the preceding rejection frequently arises in the 
context of claim rejections for lack of enablement rather than for 
claim indef initeness. See Ch i sum § 7.03[3][c] and Tn rp Me^tnalfp,^ 

410 F.2d 1378, 161 USPQ 789 (CCPA 1969). Tn rp, MPtralfP holds that 
insufficiency of disclosure rejections due to "Risk of the Future" 
are to be decided on a case-by-case basis using a rule of reason 
analysis. Id. at 1382, 792. Tn rp Mptnalfp observes that there 
always exist a "possibility," however remote, that at some future 
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date a material or an apparatus might no longer be available for 
practicing a patented invention, but that the existence of such a 
risk should not bar the issuance of a patent in every instance. 

In Ex parte Saceman, 27 USPQ2d 1472, 1474 (Bd. Pat. App. & 
Int'f 1993), the Board of Appeals, following the holding of In-Xe 
MatcaJLfa, held that "Risk of the Future" indef initeness of claim 
terms must also be decided using a rule of reason analysis applied 
to the facts of the case. In Ex parte Logan, 20 USPQ2d 1465, 
1469-70 (Bd. Pat. App. & Int'f 1991), the Board of Appeals held 
that a patent should issue on an application having a specification 
which used "pseudo-code" , metaphors and relative terminology to 
describe a computer-implemented patient inspiration detection 
method . 

In the present application, the two Examiner's Action rejec- 
tions of claims 2 and 3 quoted above allege that the claims will 
become indefinite "because there are many versions of the MPEG-X 
recommendations and the recommends are continuously updated." 
Appellant observes that the various versions of the MPEG-[X] 
specification have all been published by the International 
Organization for Standardization ("ISO") and/or International 
Electrotechnical Commission ("lEC"). Thus, the use of metaphors 
and relative terminology, respectively MPEG-1 and MPEG-2 in claims 
2 and 3 that Board of Appeals approved for computer related 
inventions in In Ex parte Logan, is reasonable for pending claims 
2 and 3 because there exist little likelihood that ISO's and/or 
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lEC's publications of the MPEG-1 and MPEG-2 specifications will 
become unavailable during the term of a patent issuing on the 
present application. 

Conclusion 

The evidence cited throughout this voluminous Appeal Brief, 
particularly as summarized in Exhibit D which compares the text of 
twice amended independent claim 1 with the pertinent disclosures in 
the Gormish, et al., the Bowater, et al. and the Davis, et al. 
patents, irrefutably establishes that even a combination of the 
disclosures in the three references, taken as a whole, fails to 
render obvious under 35 U.S.C. § 103(a) the present invention 
encompassed by claim 1, taken as a whole. The combined references 
fail to render independent claim 1 obvious for various reasons 
summarized in Exhibit D. Those reasons include the combined 
references omitting essential elements of independent claim 1.^^ 
Furthermore, even if contrary to fact the combined references were 
to render independent claim 1 obvious, for the reasons expressly 
set forth above, the combined references do not render dependent 
claims 4 and 5 obvious under 35 U.S.C. § 103(a). For all the 
preceding reasons, the Examiner's Action's rejection of pending 
claims 1-7 for obviousness under 35 U.S.C. § 103(a) must be 
overruled. 



E.g., "storing the encoded I frame data ... " 
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Appellant further observes that since all three references 
lack any suggestion that they be combined to address the problem 
solved by the present invention/^ there exists no motivation, 
except for the claims of the present application, for combining the 
references. Therefore, combining the references to reject any of 
the claims pending in the present application for obviousness under 
35 U.S.C. § 103(a) is improper. Thus, for this second reason the 
Examiner's Action's rejection of pending claims 1-7 must be 
overruled. 

Lastly, because there exists no basis except the pending 
claims for combining the references, and because the references 
when combined fail to disclose the present invention as embodied in 
the pending claims, it is readily apparent that the rejection of 
claims 1-7 under 35 U.S.C. § 103(a) for obviousness as set forth in 
the Examiner's Action dated June 8, 2001, is a canard. As set 
forth above, there exist no motivation, either explicitly or 
implicitly, in the cited references themselves suggesting that they 
be combined for the purpose of the present invention. Rather, any 
motivation to combine the disclosures of the three (3) references 
appears only in the texts of claims pending in this application. 
Thus, the rejection of the pending claims truly relies only upon an 
unpermitted artful hindsight reconstruction of the invention which 
first ascertains factually what the inventor did and then views the 



45 



I.e., images that appears to pulse visually that result 
from decoding a conventionally encoded MPEG compressed 
video bitstream of a still image. 
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prior art in such a manner as to select from the random facts of 
that art only those which may apparently be modified and then 
utilized to reconstruct the invention from such prior art. Panduit 
supra. Therefore, for this third reason the Examiner's Action's 
rejection of pending claims 1-7 for obviousness under 35 U.S.C. 
§ 103(a) must be overruled. 

Finally, for the reasons set forth above, the rejection of 
dependent claims under 35 U.S.C. § 112, second paragraph, must also 
be overruled because there exists no reasonable likelihood that 
claims 2 and 3 could become indefinite during the term of any 
patent issuing on the present application. 




Donald E. Schreiber 



A Professional Corporation 
Post Office Box 64150 



Sunnyvale, CA 94088-4150 
Telephone: (408) 541-9168 



Attorney for Appellant 
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APPENDIX I 
CLAIHa 

1. A method for producing a compressed video bitstream that 
includes compressed video data for a plurality of frames from data 
that specifies a single still image, the method comprising the 
steps of: 

5 fetching the data for the still image; 

encoding the data for the single still image into data for an 
I frame; 

storing the encoded I frame data; and 

assembling the compressed video bitstream by appropriately 
10 combining data for: 

at least a single copy of the stored I frame; 
at least one null frame; and 

various headers required for decodability of the com- 
pressed video bitstream; 
15 whereby decoding of the compressed video bitstream produces frames 
of video which produce images that do not appear to pulse visually. 

2. The method of claim 1 wherein: 

the assembled compressed video bitstream is decodable in 
accordance with the MPEG-1 standard; and 

the various headers assembled into the compressed video 
5 bitstream include: 

a sequence_header beginning the compressed video 
bitstream; 

at a beginning of group of pictures, a gr oup_start_code ; 



10 



5 



10 



for each encoded frame, a picture_start_code; and 
a sequence_end_code ending the compressed video 
bit stream. 

3. The method of claim 1 wherein: 

the assembled compressed video bitstream is decodable in 
accordance with the MPEG-2 standard; and 

the various headers assembled into the compressed video 
bitstream include: 

a sequence_header beginning the compressed video 
bitstream; 

for each encoded frame: 

a picture_header; and 
a picture_coding_extension; and 
a sequence__end__code ending the compressed video 
bitstream. 

4. The method of claim 1 wherein parameters employed in 
encoding the data for the still image produce an amount of data for 
the I frame that approaches, but remains less than, storage 
capacity of a buffer memory included in a decoder that stores the 
compressed video bitstream. 

5. The method of claim 1 wherein null frames assembled into 
the compressed video bitstream also include bitstream stuffing 
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whereby the compressed video bitstream is transmittable at a 
pre-established bitrate. 

6. The method of claim 1 wherein the various headers 
assembled into the compressed video bitstream include: 

a sequence_header beginning the compressed video 
bitstream; 

at a beginning of group of pictures, a group_start_code ; 
for each encoded frame, a picture_start_code; and 
a sequence_end_code ending the compressed video 
bitstream. 

7. The method of claim 1 wherein the various headers 
assembled into the compressed video bitstream include: 

a sequence_header beginning the compressed video 
bitstream; 

for each encoded frame: 

a picture_header; and 
a picture_coding_extension; and 
a sequence_end_code ending the compressed video 
bitstream. 
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ABSTRACT 



A data compression system uses sameness information, such 
as temporal sameness of c(xrespondlng pixels, in the coding 
process. TWo sets of contexts are used, one set when a pixd 
is tiie same as a sameness pixel, and one set of contexts for 
residual coding of the pixel when it is not the same. The use 
of the sameness bit saves computation because, if in decod- 
ing the one "sameness" bit, a decompressor determines that 
the pixel is equal to the corresponding pixel in a previous 
frame, then ho further decoding is needed for that pixel. 

23 Claims, 7 Drawmg Sheets 
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BRIEF DESaOPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of several applications using 
compression and decompression to efficiently store or trans- 
mit data; 

FIG. 2 is a more detailed view of the codd^ssot shown 
in HG. 1; 

FIG. 3 is a more detailed view of the decompressor shown 
30 in FIG. 1; 

FIG. 4 is a more detaUed view of the context modeller of 
the con^ressor shown in FIG. 2; 



tvj. 6 is a flow chart of the preceding process performed 
by a context modeller; and 

FIG. 7 is a flow chart of the decoding process performed 
by a context modeller. 

40 DESCRIFnON OF THE PREFERRED 



FTG. 1 is a block diagram of a generalized application 
where compression is used. 



FIG. 1 shows several data sources^ such as a video 

50 cassette 102, a still image 104, a video sequence 105 and a 
workstation 106 which produces rendered images. Where 
the data source is image data, and especially sequences of 
image frames, compression is needed because of the large 
amount of memory needed for uncompressed images or 

55 sequences. The present invention is described with reference 
to frame sequences, however the present invention is useful 
with other types of data sharing similar characteristics of 
frame sequence data. 
The data is input to a compressor 108 which, if designed 

60 correctly, ou^uts a compressed image or images containing 
fewer bits than the original data. If compressor 108 is a 
lossless compressor, the original data is exactly recoverable 
from the bits of the compressed data. Once the data is 
con^jressed, it is applied to a channel, several exan^les of 

65 which are shown in FIG. 1. 
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compressed file 220. Context modeller 202C has an input for 
accepting original pixels and a pixel , clock. 



5 



10 



15 

Context modefler 202C is also coupled to a frame store 
204C, to update frame store 204C with the current pixel and 
to read context pixels or context bits from frame store 204C 

20 



25 



30 



35 



40 



In operation, during each cycle of the pixel dock, com- 
pressor 108 accepts an input pixel (the "current*' pixel) from 

45 file 200, which contains the original pixels. In response to 
the current pixel, compressor 108 ou^uts a number of bits 
to compressed file 220, where the number depends on the 
state of compressor 108, and can be zero bits (ic. no bits 
output in a given input pixel cycle). In the zero bit output 

50 case, the internal state of 108 is changed. This will be 
reflected in a later compressed bit or bits. 



33 

FIG. 2 shows compressor 108 in greater detail, along with 
an original file 200 representing a sequence of uncom- 
pressed images (frames) and a compressed file 220 rcprc- 
senting a compressed version of original file 200. 



Context modeller 202C accepts the input pixel and out- 
puts one or more sets each of a context bin ID and a result 
value. 



65 

Compressor 108 moves the original data through a con- 
text modeller 202C and an entropy coder 208C to form 
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Context modeller 202C dctcnnincs the context bin ID and HO. 3 shows decompressor 122 in more detail, having 
result, according to methods explained in more detail below. many of the same elements as compressor 108. To distin- 

giiish similar elements of decompressor 122 and compressor 
108, the elements of decompressor 122 are indicated by 
similar numbers but with a *'D" suffix instead of a "CT suffix, 
such as context modeller 202D, frame store 204D, context 
model controller 206D and entropy decoder 208D compris- 
ing probability estimator 210D, context tables 212D. 214D, 
bit generator 216D and fractional bit storage 218D. 



15 



Initially frame store 2MC is empty ^ so it might not be able 
to provide contexts for very early pixels. However, the frame 
store could just be filled with an a priori value so that 
contexts can be provided for every result. After the first 
frame, frame store 204C contains at least a full frame. As 
frame store 204C fills, the oldest pixels are overwritten as 
new pixels are stored. Frame store 204C need only be large 
enough to hold the values needed to determine future 
contexts. For example, if no context referred to pixel values 
from earlier than the immediately prior frame, storage is 
only needed for one full frame. . 



20 



25 



30 



35 



40 



45 



50 



55 



60 



65 



Docket no, 2134 



12 



5,689,589 

9 10 



The update dock clocks update buffer 414 to update 
frame store 204C after the context for the current pixel is 
obtained. Of course, if frame store 204C has enough space ' 
to hold the current pixel without overwriting any pixels 
which foim the context for the current pixel, then PCLK can 
be substituted for UCLK. 

BP register 406, comparator 410, frame store 204C, and i 
CP register 408 each wovide bits or Dixels to full context 
register 412. 



15 



The operation of context modeller 202C during one pixel 
clock (PCLK) cycle will now be described. First, the current 20 
pixel is read into pixel register 402. CP register 408 
"addresses" frame store 204C to obtain the context pixels for 
the current pixel An exemplary context model is one where 
thepixeltotheleftof die current pixel forms the context In rrrr^ ^ * 

this case, the pixel to the left would be read out of frame 25 FIG. 6 is a flow chart of the process foUowed by context- 
store 204C, with CP register 408 indicating where the "i<^eller 202C to convert the current pixclinto a result and 
current pixel is, and thus where the "pixel to the left" is to ^ conte^ttfor that result. First, context model controUcr 206C 
be found. Some of the context pixels are compared by ti^termines the sameness context model and the residual 
comparator 410 to one another and to the current pixel. As ^^^^ ^"^^ SMASK and RMASK (step CI), 

shown in FIG, 4, the current pixel (designated ^'X'*) is ^ Oiice those arc set, controUogic404C cycles the pixel dock 
compared to the pixel in the immediately previous frame ^^^^ P^^* P*^®^ register 402 (step C2). In 

which occupies the same pixel position as the current pixel ^^^^ embodiments, contrd logic 404C adaptivdy changes 
does in the current frame (designated 'T'). The result of this "^^^ ^ ^ 

comparison is provided to control logic 404C. The results of sameness context is determined (step C3) by 

other comparisons, such as the pixd to the left compared 35 updating full context register 412 and masking with 
with the corresponding pbcel from a previous frame, are SMASK- If dynamic (adaptive) context modelling is used, 
provided to full context register 412. dynamic context model is determined first (step C3'). 

With the current pixd being X, the sameness test X=T is 
done (C4), and if that test result is true, a result value of 1 
40 is output (C5) along with the sameness context of the current 
pixcL The sameness test tests whether or not the current 
pixel is the same as the corresponding pixd from a previous 
frame (i.e., whether the color of the current pixd changes 
from the previous frame). This test is rejs-esented by X=T 
45 and is performed by cora{)arator 410, which reads T from 
frame store 204C and X from pixel register 402. If X=T is 
true, no other information about the current pixd needs to be 
ou^ut 
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After the residual bit output, the bit plane is compared to 
the number of bit planes (N BP), to check if it is the last bit 5 
plane (CIO). If more bit planes remain, the BP register is 
inaemcnted (Cll), and the process treats at step C8. 
Otherwise, the process continues at step C12, where a test is 
done to check if any more pixels remain to be compressed. 
This step also follows step CS. If more pixels remain to be 
processed, control logic 404C cydcs U(XK to update frame 
store 2040 (C13) and then cycles PCLK to get the next pixel 
(C14). If no more pixels remain, the process terminates 
(C15). 



Context modeller 202D checks the result (D5). If it is 1, 
indicating that the current pixd X was the same as T, Context 
modeller 202D reads T from frame store 204D and outputs 
T as the current pixel (D<>). Context modeller 202D then 
checks for more pixels (D7). If there are more pixels, frame 
store 204D is updated with pixel X (D8), otherwise the 
process ends (D9). 



25 



30 



35 



40 



FIG. 7 is a flow chart of the decompression process which 
is described with reference to FIG. 3 as well as FIG. 7. This 
process is performed by decompressor 122, including con- 
text modeller 202D. Context modeller 202D is similar to 
context modeller 202C, except that context modeller 202D 50 
inputs a result and outputs an input, thus requiting different 
control logic. 
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DUAL BUFFER VIDEO DISPLAY STSTrtM FOR 
IHE DISPLAY OF ASYNCHRONOUS IRHEGULAR 
FRAME RATE VIDEO DATA 

5 

BACKGROUND OF THE INVENTION 



10 



IS 



20 



25 



30 



15 



In computer-based video commnnicatioa systems, a 
video signal is obtained from the camera at a ccmstant 
firame rate but, after transmission across the asyncbro- 40 
nous or non-ideal network, the firames arhve at irregn- 
lar intervals. Some firames arrive early, some are de- 
layed, and bunching can occnr. The dsplay device at 
the receiving terminal, however, generally requires a 
constant &ame rate supplied to it (e^ to match the 45 
raster scan rate of a CRT). In such systems it is there- 
fore necessary to match the irregular arrival of frames 
over the network with the constant supply required to 
the output s ue eii. 



55 



, The designer of 
computer based video commnnicatioQ systems is there- 60 
fore &ced with tiie problem of how to achieve rtgolar 
play-out of the asynchronous in comin g video signal 
while, at the same time, mimmigtng the number of buff- 
ered video frames. 
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- nominal arrival time can be properly displayed. Only if 
a frame airivcs more than T(L) late, will the AVK and 
circular buffer empty and the video image will freeze- 
To decrease the risk of bufTer starvation, the buffer size 
5 can be increased to make T(L) larger, bnt with a 15 
frames per second transmission rate, storing only 10 
frames adds a delay of J second. If the effectiveness of 
mteractive applications such as video conferencing is 
not to be seriously degraded, only a handftil of frames 
10 can be buffered with T(L) correspondingly small. 
The control process is responsible first for receiving 
data into the circular buffer, and then for forwarximg it 
to the AVK. There is no control over output from the 
AVK, which is at a fixed rate. As explained in more 
15 detail below, the AVK requests frames from the circu- 
lar buffer as required. Clearly, if frames are present in 
the circular buffert then these can be forwarded to the 
AVK- However, m video conferencing or other inter- 
active applications where the overall amount of boffer- 
20 ing is limitrd, there may occasionally be particularly 
long delays on the network during which time the cir- 
cular buffer empties. In this case, the control process 
reacts by loadiiig the AVK with null frames. A null 
frame is csscntiafly the same as the preceding frame, so 
25 that, as far as the viewer is concerned, video image 
temporarily freezes. Thus, each time the control process 
fails to find frames in the circular buffer, the requisite 
number of nuH frames arc loaded into the AVK instead. 
Although the user may not notice the insertion of 
30 indivtduai null frames, each null frame adds to the over- 
all delay in the system it is effectively another form 
of buffering). If more and more null frames are inserted 
into the video stream, then this wiU, again, lead to an 
intrusive delay between transmission and display. This 
. ^ ^-^' "^"'^ ^ ^ ^ incoming video 35 problem can be overcome.by the drcular buffer throw- 
signal, from the co mmnnic a tion subsystem 15 arrives at ing away real data wbai the delayed frames do finally 
the workstation 13 for di^lay on the associated monitor anxve. These frames arc then effectively lost, allowing 
9. The signal is tiansfened first to a buffer 23, and then the displayed image to catch up with the incoming 
to the AMU card 125 or, more particularly; to the An- signal It is the presence of two buffers that gives the 
dio Visual Kcrnd (AVK) mtcrfacc buffer 25 of the 40 flexibility to lose frames in this way, and so cope with 
AMU qanL .The buffer 23 provides a FIFO queue, occasional delays kmgcr than TCL). 
conveniently mq)lementcd as a circular buffer. A con- The techmquc used to discard frames exploits the fact 
trol process 27 is responsible first for reading incoming that, doe to the limited bandwidth of the channel, the 
data into the circular buffer, and then for transferring video signal is compressed before transmission over a 
d^ from the circular buffer to tiiic AVK. 45 computer based communication line. Basically, two 

types of compression, spatial and temporal, are used. In 
the former, the redundancy within a single frame is 
removed, for example, by using the feet that adjacent 
pixds often have dosdy related brightness and color 
However, the trans^ 50 values. A frame encoded using only spatial compression 
mission rate over the nctworic is variable, depending on is known as a "still frame". Temporal compression 
ttetworicload,ctc,sothatthcarrival.rateattheendof achieves a fWthcr Icvd of compression by exploiting 
the computer snhsystcm departs from this 15 Hz dock. the fact that the luminosity and cdor of the same pixel 
Changes in CPU activity at the source and destination in two consecutive firames are, again, likely to be highly 
computers can abo lead to variations in the effective 55 correlated. Therefore, m temporal compression, a frame 
frame arrival rat& Individnal frames can have either a is encoded as a "relative frame" in terms of its differ- 
positive or negative oC&ct from their nominal arrival encc from the previous frame (we assume that a relative 
tiuM^ although it is assumed that frames do, in fact, frame is also spatialiy compressed). The greatest rednc- 
arrivc in the correct seqoence. It should be noted that tion in data is achieved if every frame (apart from the 
the variation in arrival times is such that, even if die 60 first) is a relative frame, but this is highly error prone 
hardware could display each frame directly on arrival, since the loss, of a single frame will produce defects that 
the resulting sequence would be so temporally distorted per^ for all subsequent frames^. Therefore, as a com- 
as to be unwatchabk. promise, every Nth frame can be sent as a stiD frame. 

with aH intervening frames as relative frames, so that 
TpgcthCT, the AVK aad drcular buffer compensate 65 the result of compression is a regulariy spaced series of 
for the variable arrival niteofthe video francs by intro- frames whose size varies somewhat according to the 
ducing a time-lag, T(L), between the received and di&- temporal and spatial content of the data and, of course, 
played images. Any frame arriving within T(L) of its whether that particular frame is a still or relative frame. 
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When the Irafferis not full, then inooming firames 
can be added to the bttfifer in the nonml way. However, 
when the buffer is ftill, there are two possible actiona. If 10 
the incoming firsme b a sdll hsmc, then^ entire buffer 
is flxnhcd before the incoming still &ame is added to the 

Alteinativdy, if the incoming ficsme is a relative 
frame, then ody relative firaes bdow (Le^ that arrived 
earlier than) a 8tin frame are fhohed. This is because the 15 

previoos st31 frame is still xeqmred to make sense of the 
relative frames. In either case* flushing the bnffer results 
in some frames bdng thrown away, and so tiie displayed 
image cat^iife-upsli^y with the received image. 



25 



Tninmg now to the AVK. frames are read out from 
the AVK for display at a fried rate. This leads to the 
possibility of buffer starvation if the AVK contains no 
more frames to read out to the screen. In such an even- 35 
tuality, the AVK pipeline needs to be reset, requiring a 

considerable system overhead during ^^nch time the 
video image is not updated, in contrast to the drcnlar 
bufier, which can be emptied and refilled without pen- 
alty. 40 

Accordmgly, a tower Kmit, V(L), is set for the num- 
ber of frames in the AVK. This value is selected to 
substantially preclude buffer starvation yet, at the same 
time, not introduce an unaccq>table dday. The control 
process responsible for transferring frames from the 45 
dicular buffer to the AVK then tries to nwrntaTn the 
number of frames in the AVK as close as possible to but 
.. sliehtlv above VOL). 



55 



Once the control process has determined the number 
60 of frames to transfer to the AVK« it can either send this 
as a single request, or as an appropriate number of re- 
quests for individual frames. In ^e latter case, the circu- 
lar buffer can respond simply to each request by trans- 
ferring a frame if available; or insertmg a null frame if 
65 not 
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[57] 



ABSTRACT 



A method and device for preprocessing streams of encoded 
data (e.g. compressed in accordance with an MPEG 
standard) to permit a decoder to decode the streams, back- 
to-back (Lc., one stream immediately following another), 
without being reset and without producing video artifacts. 
The present invention includes verifying that a multiplexed 
stream complies with an encoding standard and preprocess- 
ing pack£i5 of the packetiidcd encoded video sequence such 
that no video artifacts are produced when a video decoder 
decodes an adjacent encoded video sequence. 

17 Claims, 16 Drawing Sheets 



Docket no. 2134 



-1- 



EXHIBIT C 



U.S. Patent Nov. 17, 1998 Sheet 1 of 16 5,838,678 



IX, 



Docket no. 2134 



-2- 



EXHIBIT C 



U.S. Patent 



Nov. 17, 1998 



Sheet 2 of 16 



5,838,678 




00 



NO 

o- 

C>1 



(N 

o- 



CO 

8 
>> 

S 

ca 
o 

a 
W 

CU 






o 
o 



fu, ^ -6 ja 



0^ CO U 



CM 



c 
o 

• rH 

c 

CO 4i 



cn 
O 



> C/3 U 



2 -S 

T3 o 

cd o 



u 
w 



So 



Y 




optional 
fields 




CO 




bO 




CO 




Cm 









00 



SI 



C3 CO 
CO CO 



C CCS 

•w eg 

CO t3 

CO <u 2 



o 

CO 

GO <l> 2 ^ 

w w a g 



Pit X) 




CU CO 



M ^ ^ 

o cd 'tj 

ffj o JJ 

a 4;^ ^ 



CO > M 

CU a 



00 



CO 



d 



< 
a; 

o 



Docket no. 2134 



-3- 



EXHIBIT C 



U.S. Patent 




Nov. 17, 1998 



Sheet 3 of 16 



5,838,678 




<0 

o 



n 

CO 



O 

a 

CO 

-s 

o 
o 

a 

< 



Docket no. 2134 



-4- 



EXHIBIT C 



U.S. Patent Nov. 17, 1998 Sheet 4 of 16 5,838,678 



video sequenceO { 300 


No. of bits 


Mnemonic 


next_start_codeO 






sequence headerO 302 






if (nextbitsO = extension_start_code) { 






sequence extensionO 304 






do{ 






extension and user data(O) 306 






do{ 






if (nextbitsO = group_start_code) { 






308 


groiip_of_j)ictures_headerO 






310 


extension_and„user_data( 1 ) 






} 






312 


picture_headerO 






314 


picture_coding_extensionO 






316 


extensions_and_user_data(2) 






31$ 


pictuxe_dataO 






} while ( (nextbitsO=picture_start_code) II 






(nextbitsO = group_start_code) ) 






if (nextbitsO! = sequence_end_code) { 






sequence_headerO 






sequencc_extensionO 






) 






} whi]e(nextbitsO!=scquence_end_code) 






} else { 






/♦ISO/EEC 11 172-2 */ 






} 






sequence_end code 320 


32 


bslbf 


} 
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picturc_headeiO { 


312 


No. of bits 


Mnemonic 


picture_start_codc 


502 


32 


bslbf 


temporal_reference 


504 


10 


dxnsbf 


picture coding type 


3 


ounsbf 


vbv_delay 


16 


uimsbf 


if(picture_codine type = 2 il picture_codine type = 3) { 






full_pel_forward_vector 


1 




forward_f_code 


3 


uimsbf 


} 






if (pictiire_coding_type = 3) ( 






fiiIl_peI_backward_vector 


1 




backward_f_code 


3 


uimsbf 


} 






while (nex«)itsO = 'r) { 






extra_bitj3icture /* with the value '1' ♦/ 


1 


uimsbf 


extra_infoniiation_picture 


8 




) 






cxtra_bit_picture /* with the value '0' */ 


1 


uimsbf 


next_3tart_codeO 






} 







FIG. 5 (PRIOR ART) 



group of pictures headerO { 308 


No. of bits 


Mnemonic 


group_start_code — 604 


32 


bslbf 


tiiiic_code 


25 


bslbf 


closed_5op - — ^ — - 602 


1 


uimsbf 


broken Jink 


1 


uimsbf 


next_start_codeO 






} 
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METHOD AND DEYICK FOR 
PREPROCESSING STREAMS OF ENCODED 
DATA TO FACBLnATE DECODING 
STREAMS BACK-TO BACK 



5 



BACKGROUND OF THE INVENTEON 



a. Field of the Invention 



10 



• 15 



b. Related Ait 

Hie MPEG standard focuses on the encoding and trans- 
port of video and audio data. In general, the \fPEG standard 
uses compression algorithms such that video and audio data 
may be more efficiently stored and communicated. 

The International Organization for Standardization (or the 
Organization IntcmatioQal Do Normalisation) (hereinafter 
referred to as "the ISO/IEC*) has produced the MPEG 11 
standard for the coding of moving pictures and associated ^ 
audio. This standard is set forth in four documents. The 
document ISO/TEC 13818-1 (systems) specifics the system 
coding of the specification. It defines a multiplexed structure 
for combining audio and video data and means of repre- 
senting the timing iafcnnalioa needed to replay synchro- 3Q 
nized sequences of the audio and video dau in real-time. Tlie 
document ISO/IEC 13818-2 (video) specifics the coded 
representation of video data and the decoding process 
required to reconstruct pictures. TTic document ISO/IEC 
13818-3 (audio) specifies (he coded representation of audio 35 
data and the decoding process required to reconstruct the 
audio data. Lastly, the document ISO/IEC 13818-4 
(confurmance) specifics prucedures for determining Ihe 
characteristics of coded bitstreams and for testing compli- 
ance with the requirements set forth in the ISO/EEC docu- ^ 
ments 13818-1, 13818-2, and 13818-3. These four 
documents, hereinafter referred to, collectively, as "the 
MPEG II standard" or simply 'Uhe MPEG standard", are 
incorporated herein by reference. 

A bit stream, multiplexed in accordance with the MPEG 45 
standard, is either a "transport stream" or a "program 
sueam**. Doth program and transport streams are constructed 
from "packetizcd elementary stream" (or PES) packets and 
packets containing other necessary information. A "pack- 
ctized elementary stream" (or PES) packet is a data structure 50 
uscti to carry "elementary stream data*". An "elementary 
stream" is a generic term for one of (a) coded video, (b) 
coded audio, or (c) other coded bit streams carried in a 
sequence of PES packets with one and only stream ID. 
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FIG. 2 is a diagram wbicb illustrates the syntax of a PES 
packet 200. . 



FIG. 7 is a high level block schematic showing a system 
for encoding, communicating, and decoding video and audio 
data in accordance with the MPEG 0 standard. 

20 



25 



30 



35 



The transport stream multiplexer 712 multiplexes the 
encoded audio and video packets to form a transport stream 
100 and provides the transport stream 100 to communica- 
45 tions link 722, At a remote end of the communications link 
722, a transport stream demultiplexer 724 receives the 
multiplexed transport stream 100. 



50 



55 



60 



As mentioned above, transport streams 100 permit one or 
more programs with one or more independent time bases to 
65 be combined into a single stream. That is, a transpon stream 
too may include a first program and a second program. In 
presently contemplated systems, both the video decoder 730 
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and the audio decoder 734 must be reset before decoding a 
next program, for reasons which will be explained below. 
Thus, Cur example, in such sysLcms there must be a lempurBl 
gap (e.g., one sccx}nd) between the decoding of the first and 
second programs to permit the video and audio decoders 730 5 
and 734, rcspcctiveiy, lo be reset. This temporal gap pre- 
cludes the playing of the second program directly following 
the first program. Moreover, it is difficult to dctcraiinc when 
one program ends and another begins in real-time. Thus, a 
method and/or a device is needed to permit more than one lO 
program to be played (i.e., decoded) back-to-back. The 
method and/or device should also overcome, or avoid, the 
difficulties of determining program boundaries in real-time. 



678 

6 

an audio sequence and a video decoder can, without being 
reset, decode the encoded video sequence to pruduce a video 
sequence. The method of the present invention (i) verifies 
that the multiplexed stream complies with an encoding 
standard, (ii) preprocesses packets of the packetized, 
ctxx)dcd, video sequence such that no video artifacts arc 
produced when the. video decoder decodes an adjacent 
encoded video sequence, and (iii) preprocesses the packets 
of the packctizcd; encoded, audio data sequence such that its 
start time is within a fiist predetermined dme of the start 
time of the video sequence and its temporal length is within 
a second predetermined time of the temporal length of the 
video sequence. 

The step of preprocessing the packets of the packctizcd, 
eDCO(.led, video sequence preferably includes (i) deleting any 
video frames that cannot be decoded if video firamcs of the 
video sequence are not temporally correct, and (ii) deleting 
any video frames following a code indicating an end of the 
encoded video sequence. The step of preprocessing the 
packets of the packetizcd, encoded, audio sequence prefer- 
ably includes (i) removing any partial audio frames, (ii) 
adjusting (Lc., adding or deleting) the number of audio 
Eramcs, if necessary, such that the audio and video sequences 
start within the first predetermined time, and (iii) adjusting 
(i.e., adding or deleting) the number of audio fi"ames, if 
necessary, such that the temporal lengths of the audio and 
video sequences are within the second predetermined time. 
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Thus, as can be appreciated from the above discussion of 
MPEG and MPEG II video encoding, the video decoder 730 
often needs past and future frames to decode a picture 
(B-Picturc) frame. If the last temporal (displayed) frame of 
a first program is used in decoding a first temporal 
(displayed) frame of a second program, or if a partial video 
frame is used, the output of the video decoder ^0 will have 
been improperly decoded, disadvantageously causing video 
artifacts. Thus, as discasscd above, the decoders mu.st be 
reset between programs in known systems. 



SUMMARY OF Tim INVENTION 

60 



Specifically, the present invention provides a method for 
preprocessing multiplexed streams of packets of packetized, 65 . 
encoded, audio and video .sequences such that an audio 
decoder can decode the encoded audio sequence to produce 
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FIG. 6 illustrates the structure of a group of pictures 
header of ttie MPEG 11 video sequence of FIGS. 3fl and 3b. 

FIG. 7 illustrates an eocoding, traasmission, and decoding 
system envisioned by MPEG II. 
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BRIEF DESCRIPTION OF TIIE DRAWINGS 



FIG. 2 is a diagram which illustrates the syntax of an ^ 
. MPEG 11 PES packet 

FIGS. 3a and 3b illustrate the organization of an MPEG 
II video sequence. 

FIG. 4 illuslralcs Ihc slruclure of a sequence header of the T 
MPEG II video sequence of FIGS. 3a and 36. < 

FIG. 5 illustrate?; the stnicnirc of a picture header of the 
MPEG II video sequence of FIGS. 3a and 36. 
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